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Nonlinear  Instabilities  in  TCP-RED 

Priya  Ranjan  and  Eyad  H.  Abed 


Abstract — This  work  introduces  a  discrete  time  model  for 
a  simplified  TCP  network  with  RED  control.  It  is  argued 
that  by  sampling  the  state  space  at  certain  instants,  the  dy¬ 
namics  of  the  system  can  be  described  explicitly  as  a  discrete 
time  feedback  control  system.  This  system  is  used  to  analyze 
the  operating  point  of  TCP-RED  and  its  stability  with  re¬ 
spect  to  various  controller  and  system  parameters.  With  the 
help  of  bifurcation  diagrams,  it  is  numerically  shown  that 
non-trivial  (not  due  to  the  discontinuity  in  the  system  or  the 
control  law)  instabilities  in  the  system  are  possible  due  to 
the  presence  of  a  strong  nonlinearity  in  the  characteristics 
of  TCP  throughput  of  a  sender  as  a  function  of  drop  prob¬ 
ability  at  the  gateway.  Some  of  the  bifurcations  observed 
in  the  system  are  the  period-doubling  sequence  and  border 
collisions  leading  to  a  change  in  the  system  periodicity  and 
chaos.  Analytical  techniques  are  provided  to  help  in  the  un¬ 
derstanding  of  this  kind  of  anomalous  behavior.  An  explicit 
stability  condition  in  terms  of  different  parameters  is  given. 

Keywords — Congestion,  computer  networks,  chaos,  bifur¬ 
cation,  control 

I.  Introduction 

Computer  networks  arc  highly  complicated  systems, 
both  in  their  temporal  and  spatial  behavior  [1].  Although 
they  have  traditionally  been  modeled  and  analyzed  using 
stochastic  methods,  there  have  recently  been  several  pa¬ 
pers  that  use  deterministic  nonlinear  modeling  and  analy¬ 
sis  (e.g.,  [6],  [7],  [8],  [16],  [14],  [5]). 

In  this  paper,  we  study  a  modified  deterministic  dynam¬ 
ical  model  of  a  simple  computer  network  running  TCP  at 
the  sender  end  and  implementing  RED  at  the  router  end. 
The  basic  model  that  we  consider  was  proposed  recently 
by  Firoiu  and  Borden  [5].  We  modify  their  model  with  a 
simpler  TCP  throughput  function  [3],  [4]  to  facilitate  anal¬ 
ysis.  The  calculations  we  give  here  show  that  the  model 
exhibits  a  rich  variety  of  bifurcation  behavior  leading  to 
chaotic  behavior  of  the  computer  network.  The  bifurca¬ 
tions  occur  as  control  parameters  are  slowly  varied,  mov¬ 
ing  the  dynamics  from  a  stable  fixed  point  to  oscillatory 
behavior  and  finally  to  a  chaotic  state. 

A  glimpse  at  the  history  of  network  congestion  con¬ 
trol  reveals  significant  attempts  to  control  congestion  in 
the  general  network  and  telephony  literature.  Conges¬ 
tion  and  synchronization  in  tandem  telephone  queues  have 

The  authors  are  with  the  Department  of  Electrical  and  Computer  En¬ 
gineering  and  the  Institute  for  Systems  Research.  University  of  Mary¬ 
land,  College  Park.  MD  20742  USA.  Email:  abed@isr.umd.edu. 


been  studied  in  [15]  using  a  piecewise  affine  model.  A 
similar  model  has  been  applied  to  the  dynamics  of  choke 
packets  in  a  LAN  to  explain  synchronization  and  sustained 
oscillations  [16].  These  models  indeed  explain  qualitative 
changes  in  the  operation  of  a  network  or  that  of  a  network 
component  as  parameters  cross  critical  values.  In  contrast 
to  the  deterministic  setting  of  [15]  and  [16],  multi-stability 
or  emergence  of  pseudo-stable  states  has  been  reported  in 
a  stochastic  setting  in  [14],  The  paper  discusses  the  qual¬ 
itative  changes  in  the  stochastic  behavior  of  the  network 
due  to  parameter  change,  which  may  lead  to  degradation 
in  network  performance. 

There  have  been  several  attempts  to  deal  with  conges¬ 
tion  in  TCP  which  is  the  most  popular  network  mechanism 
for  data  transfer.  The  most  important  scheme  to  avoid  im¬ 
pending  congestion  was  published  in  [2]  and  is  known  as 
random  early  drop,  or  RED.  The  basic  idea  of  RED  is  to 
sense  impending  congestion  before  it  happens  and  try  to 
give  feedback  to  the  sender  by  dropping  its  packets.  The 
dropping  probability  is  the  control  administered  by  the 
gateways  once  they  detect  queue  build-up  beyond  a  cer¬ 
tain  threshold.  This  scheme  involves  three  parameters:  1) 
Pmax,  2)  qmax,  and  3)  qmin  that  need  to  be  selected.  (The 
meanings  of  these  parameters  will  be  identified  in  the  next 
section.)  Most  of  the  rules  for  setting  these  parameters  are 
empirical,  and  come  from  networking  experience.  These 
rules  have  been  evolving  as  the  effects  of  controller  pa¬ 
rameters  is  not  very  clearly  understood.  There  are  papers 
discouraging  implementation  of  RED  (e.g.,  [9]),  arguing 
that  there  is  insufficient  consensus  on  how  to  select  con¬ 
troller  parameter  values,  and  that  RED  does  not  provide  a 
drastic  improvement  in  performance. 

Initially,  there  was  very  little  in  the  way  of  mathemat¬ 
ical  modeling  of  TCP-RED.  However,  with  the  recent  ef¬ 
forts  toward  modeling  TCP  throughput  for  a  transmission 
line  with  a  packet  drop  probability  [5],  [6],  [7],  [8],  [4], 
several  papers  have  discussed  TCP-RED  in  the  framework 
of  feedback  control  systems.  Most  of  the  models  used  are 
continuous-time  and  the  analysis  uses  basic  control  the¬ 
oretic  results.  The  biggest  problem  with  the  continuous¬ 
time  models  is  their  inability  to  reflect  delay,  which  is 
prominent  in  networks  and  can  be  very  significant  for  large 
trunks  [7],  [8],  Continuous-time  models  with  variable 
(state  dependent)  delay  arc  hard  to  analyze  [8].  The  analy¬ 
sis  reported  on  these  models  deals  mostly  with  the  stability 
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of  fixed  points  and  limit  cycles  under  different  parameter 
settings.  For  the  first  time,  chaotic  behavior  of  TCP  has 
been  reported  in  [13].  The  evidence  for  this  irregularity  is 
mostly  explored  by  simulations.  Some  theoretical  work  on 
flow  synchronization  in  TCP  has  been  reported  in  [4],  [17], 
but  one  of  the  very  important  issues  which  currently  isn’t 
well  understood  is  how  does  a  smoothly  operating  network 
transition  into  chaos.  To  borrow  dynamical  systems  termi¬ 
nology,  the  route  to  chaos  starting  from  a  stable  fixed  point 
is  not  well-studied. 

In  this  work,  a  discrete-time  map  will  be  used  to  model 
the  TCP-RED  interaction.  A  dynamical  systems  approach 
will  be  used  to  explain  the  loss  of  stability,  bifurcation  be¬ 
havior,  and  routes  to  chaos  in  TCP-RED  networks.  We  will 
use  bifurcation-theoretic  ideas  to  explain  nontrivial  peri¬ 
odic  behavior  of  the  system.  The  appearance  of  bifurca¬ 
tion  and  chaos  should  not  be  surprising,  considering  that 
the  system  response  is  nonlinear  especially  during  heavy 
load  conditions.  We  will  show  the  performance  of  the  sys¬ 
tem  as  a  function  of  various  control  and  system  parameters 
in  general  and  try  to  explain  these  irregular  behaviors  with 
the  help  of  bifurcation  diagrams. 

Our  work  begins  by  realizing  that  the  model  proposed 
in  [5]  can  be  viewed  as  a  first-order  (rather  than  third- 
order)  discrete  nonlinear  model.  Our  replacement  of  the 
TCP  throughput  function  of  [5]  with  a  simpler  version 
makes  the  analysis  feasible.  However,  symbolic  calcula¬ 
tions  could  be  used  to  allow  treatment  of  the  more  complex 
throughput  function  of  [5].  The  advantage  of  the  current 
work  is  that  the  calculations  arc  simple  enough  that  the 
results  arc  easily  understood. 

We  borrow  the  model  proposed  by  Firiou  et  al.  [5]  and 
use  the  well  known  formula  for  TCP  throughput  proposed 
by  many  others  including  [3],  [4],  The  motivation  behind 
not  using  Firiou’s  forumla  for  TCP  throughput  is  its  com¬ 
plexity.  Complex  operations  like  inverse  of  a  function  in 
different  parameters,  which  arc  needed  to  connect  the  TCP 
to  the  control  mechanism  RED,  demand  simplicity  in  the 
TCP  throughput  formulation.  This  seems  to  be  the  reason 
why  Firiou  et  al.  postponed  the  study  of  their  proposed 
map  [5].  Although  this  TCP-RED  formulation  may  not 
be  the  exact  representation  of  the  complicated  mechanism, 
it  does  give  a  qualitative  handle  on  its  dynamics  and  en¬ 
hances  our  understanding  of  chaos  and  other  instabilities. 
We  hope  that  this  understanding  will  lead  to  monitor  the 
network  congestion  better  and  help  us  in  formulating  ro¬ 
bust  but  simplified  control  mechanisms. 

This  paper  is  organized  as  follows.  In  Section  2,  we  de¬ 
scribe  the  TCP-RED  mechanism  in  control  system  frame¬ 
work.  Section  3  contains  the  discrete  map  of  TCP-RED 
mechanism.  Section  4  deals  with  the  stability  of  this  map 


which  is  the  core  of  the  paper.  Section  5  tries  to  explain  the 
different  nonlinear  phenomena  we  have  observed  in  our 
models  and  tty  to  make  a  connection  with  chaotic  scenario. 
Finally,  in  section  6  we  discuss  the  results  in  networking 
context. 

II.  TCP-RED:  Feedback  System  Modeling 

A  computer  network  implementing  TCP-RED  is  essen¬ 
tially  a  feedback  loop  where  senders  adjust  their  sending 
rate  based  on  the  feedback  they  receive  from  their  near¬ 
est  routers  in  the  form  of  dropped  packets.  Routers  on 
the  other  hand  implement  a  control  policy  which  can  be 
either  drop  tail  or  RED  [2].  There  have  been  different  ap¬ 
proaches  to  model  the  dynamics  of  TCP-RED  and  various 
control  schemes  have  been  proposed  [5],  [6],  [7],  [8],  [4] 
not  only  to  control  the  system  but  to  also  enhance  its  dy¬ 
namic  performance.  We  closely  follow  the  approach  taken 
in  [5]  with  a  modified  TCP  throughput  formula. 

Senders 


Each  flow  at  a  router  sends  packets  with  rate  rSA.  The 
sending  rates  of  all  n  flows  combine  at  the  buffer  of  link 
l  and  generate  a  queue  of  size  q  which  is  limited  by  its 
buffer  size  B.  The  controller  at  the  router  drops  packets 
with  probability  p  which  is  a  function  of  average  queue 
size  q.  For  ith  flow  let  the  forwarding  rate  at  the  router  be 
rt,i  which  is  the  same  as  rS;j  sans  dropped  packets.  When  a 
sender  notices  that  its  packets  arc  being  dropped,  it  adjusts 
its  sending  rate  based  on  the  drop  probability  p  it  observes. 

This  makes  a  control  system  with  sender’s  rate  as  con¬ 
trol  variable  with  the  controller  sitting  at  the  router  which 
issues  the  feedback  signal  in  the  form  of  a  drop  probability. 
The  aim  of  this  control  system  is  to  keep  the  cumulative 
throughput  below  or  equal  to  the  link’s  capacity  c: 

V]=1rtJ  <  c 

Let’s  assume  for  simplicity  that  TCP  flows  have  a  long 
duration  and  that  their  number  n  does  not  change,  then 
the  throughput  of  each  TCP  flow  follows  the  steady  state 
model  derived  in  [3],  [4], 
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RED  Module 

Fig.  2.  Feedback  control  system  corresponding  to  the  network 
shown 


where 


rt,i  =  T(p, ,  Ri) 


T(p,R ) 


M  k 
R  y/p 


(1) 


G(p) 


ma x(B,  ^{TRl{;p,  ± )  -  R0)) 
0 


Where 


P<Po 

otherwise 

(2) 


R0  =  propagation  and  transmission  time  and 

Po  =  T~l{c/n,R{ 0) 


Tr1  (c/n.  Ro)  denotes  the  inverse  of  T(p.  II)  in  R, 
Tp  1  (c/n,  Rq  )  denotes  the  inverse  of  T (p,  R)  in  p  and  po  is 
maximum  probability  for  which  the  system  is  fully  utilized 
i.e.  for  p  >  po  senders  will  have  their  rates  too  small  to 
keep  the  link  fully  utilized.  For  T(p,  R)  defined  by  eq.  1. 


G(p) 


ma x(S,  -  Rq) 

0 


(3) 


if  P  <  Po 
otherwise 


(4) 


T 

M 

R 

k 

P 


Throughput  of  a  TCP  flow  (in  bits/sec) 
Maximum  Segment  Size  or  Packet  Size 
Round  Trip  Time 

constant  which  varies  between  1  and  \/8/3  [3] 
probability  of  packet  loss 


RED  control  law  can  be  expressed  as  follows: 


P 


nm 

f  0 


Qe  Qmin 
Qmax  Qmin 

1 


Pmax 


i  0  A  qe  <  Qmin 
;  Qmin  'T  (j t  A  Qmax  (5) 
j  Qmax  A  Qe  T  B 


To  simplify  matters  even  further  let’s  assume  that  all  flows 
are  uniform  or  they  all  have  same  round  trip  time  R,  same 
maximum  segment  or  packet  size  M  and  maximum  con¬ 
gestion  window  size  advertised  by  TCP’s  receiver  Wmax 
is  large  enough  to  not  affect  T (p,  R) .  This  implies 

rt,i{p,R)  =  rtj{p,R),  1  <  i,j  <  n  and  hence 


n 


So  this  assumption  enables  us  to  reduce  the  n-flow  sys¬ 
tem  to  a  single  flow  system  with  feedback  although  it  is 
important  to  keep  in  mind  that  feedback  is  based  on  the 
sending  rate  of  all  the  flows  since  the  router  has  no  way  to 
differentiate  between  them,  at  least  in  this  set  up. 

To  define  this  control  system  mathematically,  we  model 
the  queue  as  a  function  of  control  variable  q  =  G(p), 
which  acts  like  a  plant  in  control  system  literature.  To  an¬ 
alyze  this  control  system  we  also  need  the  control  func¬ 
tion  p  =  H(q)  implemented  at  the  gateways.  This  control 
function  H  is  given  by  the  policy  implemented  at  the  drop 
module,  such  as  Drop-Tail  or  RED  [2].  Now  following  the 
procedure  suggested  in  [5]  we  can  define  the  plant  function 
G(p)  as  follows: 


where  q,  is  the  exponential  weighted  moving  average  of 
queue  size,  qmin,  qmax,  pmax  are  configurable  RED  pa¬ 
rameters,  and  B  is  buffer  size. 

III.  Discrete  model  for  TCP-RED 

It  is  argued  in  [5]  that  TCP  adjusts  its  sending  rate  de¬ 
pending  on  whether  it  has  sensed  that  packets  are  dis¬ 
carded.  Hence,  this  process  can  be  modeled  as  a  strobo¬ 
scopic  map  where  the  instant  of  observation  is  one  RTT 
or  return  trip  time.  This  technique  has  been  utilized  before 
for  different  clocked  systems  in  power  electronics  for  mod¬ 
eling  the  dynamics  of  power  converters.  Following  simi¬ 
lar-  arguments  it  seems  reasonable  to  model  TCP-RED  dy¬ 
namics  as  a  discrete  map.  Although  one  would  prefer  that 
the  sampling  interval  be  regular-,  there  are  models  where 
the  dynamics  is  sampled  at  irregular  intervals  and  the  re¬ 
sulting  maps  are  known  as  “impact  maps”  [11], 

Let  pk  be  the  drop  probability  at  t^.  At  time  t^+i  = 
tk  +  RTT  the  sender  observes  drop  rate  pi  and  in  an  av¬ 
erage  sense,  adjust  its  sending  rate.  This  in  turn  forces  the 
buffer  to  its  new  state  Qk+\  =  G(pk)  following  the  queue 
law  in  eq.  4.  The  RED  module  now  computes  a  new  esti¬ 
mate  of  queue  size  qe  k+1  =  A(qe  k,  qk+ 1),  following  the 
exponential  weighted  moving  average: 
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^(?e,fe>  Qk+i)  =  (1  -  w)qe,k  +  wqk+1  (6) 

where  w  is  the  weight  used  for  averaging.  After  comput¬ 
ing  qe  k+l,  the  RED  module  adjusts  it  dropping  rate  to 
Pk+i  =  H(qek+ 1)  given  by  its  “feedback  control  law” 
in  eq.  5.  This  completes  the  description  of  a  discrete  time 
dynamical  system  modeled  as  follows: 


qk+i  =  G(pk) 

Qe,k+ 1  Qk+1 ) 

Pk+i  =  H{qek+ 1)  (7) 

From  eq.  7  one  can  derive  a  simple  one  dimensional  re¬ 

currence  equation  since  map  G(.)  and  map  II (.)  has  no 
dynamics.  The  only  dynamics  that  comes  into  the  picture 
is  in  map  A(., .).  After  substitution  one  can  easily  derive 
the  following  equation  for  exponential  weighted  moving 
average  for  queue  length  at  time  tk+ E 

Qe,k+ 1  =  (1  —  w)Qe,k  +  wG{H(qek))  (8) 

Below,  we  illustrate  some  interesting  dynamical  behavior 
of  eq.  8.  This  equation  is  rather  simple  in  most  of  its  do¬ 
main  of  definition. 

We  know  that  G(.)  is  identically  0,  V  p  >  p®.  So  we 
can  find  corresponding  value  b\  of  qe  k  such  that  for  any 
qek>  b i,  G(.)  is  identically  0  if  we  assume  a  monotone 
feedback  law. 


{po  (g  max  Qmin )  _i_  n  fir  \ 

Pmax  ^  q'nin  ’  U  PmaX  ~  P0  (9) 

qrnox  ,  otherwise 

This  gives  an  explicit  formula  for  map  in  eq.  8  V  qe  k  >  b\ : 

qe,k+ 1  =  (i  -  w)qe,k 

Now  consider  the  other  boundary  value  62  of  qe  k  such 
that  V  qe  k  <  bo  we  have  G(.)  =  B  or  buffer  is  always 
full.  This  value  can  be  computed  from  eq.  4  and  eq.  5.  62 
is  given  by: 


bo  = 


nk 


B+ 


Roc 


Pmax 


~(Qmax  Qmin )  Qmin  (10) 


This  gives  an  explicit  formula  for  map  in  eq.  8  V  qe  k  < 

b2- 

Qe,k+ 1  =  (1~  W)qe,k  +  WB 


It  is  clear  that  most  of  the  interesting  dynamics  happens 
for  t>2  <  q(:  /.  <  b\.  Map  in  eq.  8  can  be  written  for  this 
region  as  follows: 


Fig.  3.  Feedback  law  H(qek )  in  red  and  queue  law  G(p)  in  blue 


7e,fc+ 1 


(!  -  w)qe)k  +  w{ 


f(Qe,k>P) 


nk 


max  ( 9e,fc-9m  in) 
( Qmax  Qmin) 


Roc 
M  ’ 

(11) 


where  p  summarizes  the  parameters  in  the  system. 


Fig.  4.  1 .  Red  curve  shows  first  return  map,  2.  blue  curve  shows 
second  return  map,  and  3.  green  line  is  45°  line  whose  in¬ 
tersection  denotes  the  fixed  points  of  the  map 

We  remark  that  solving  eq.  1 1  leads  to  a  third  degree 
polynomial  in  fixed  point  q*e  which  interestingly  does  not 
depend  on  w  as  should  be  expected  since,  both  the  “queue 
law”  and  the  “feedback  control  law”  are  not  functions  of 
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w.  The  polynomial  is  given  below. 


(q*e  ~  qmin)(q*e  + 


Roc)2  =  ink)2 

M  Pmax 

IV.  Stability 


( qmax  qmin )  (12) 


Stability  of  this  fixed  point  q*e  can  be  assessed  by  com¬ 
puting  its  eigenvalue: 


df{qe,k,p ) 


dqt 


=  1  —  w  — 


wnk 


I  Qmax  Qmin 


e,k 


Qmin)2 


Pmax 


■■=  Kp) 


(13) 


Although  X(ql,p)  is  a  function  of  the  fixed  point  q*  it¬ 
self,  we  know  that  the  fixed  point  will  always  be  bounded 
from  above  by  f(b2,p)  and  from  below  by  f(b\ ,  p).  It  is 
also  clear  that  f(b2lp)  >  f(b\,p)  since  control  mecha¬ 
nism  kicks  in  once  the  queue  length  at  the  router  grows 
beyond  b2  decreasing  the  average  queue  length.  In  fact 
f(~qe  k.  p)  decreases  monotonically  in  the  interval  b2  to  b\, 
but  the  slope  decreases  in  the  magnitude.  Hence  an  ap¬ 
proximate  stability  condition  for  fixed  point  in  terms  of 
parameters  can  be  derived  by  taking  the  upper  bound  of 
f{q*e,p)  which  is  f{b2,p)  and  thats  when  /(gefc,  p)  has  its 
eigenvalue  negative  and  largest  in  magnitude.  Hence,  this 
stability  condition  can  be  formulated  as: 


\X(q*e,p)\  <  1,  or  by  substituting  b2  by  q*e 
wnk 


1  —  w  — 


'  Qmax  Qmin 


2(^2  qmin )  2 


Pmax 


<  1 


(14) 


on  fixed  point  of  the  map  with  different  values  of  expo¬ 
nential  averaging  weight  w.  We  analyze  this  effect  with 
the  help  of  numerical  bifurcation  diagrams. 

A.  How  to  Read  a  Bifurcation  Diagram 

A  bifurcation  diagram  shows  the  qualitative  changes  in 
the  nature  or  the  number  of  solutions  of  a  dynamical  sys¬ 
tem  as  a  parameter  varies.  On  the  horizontal  axis  we  plot 
the  different  value  of  parameter  ( qmin  or  w  in  this  case). 
The  vertical  axis  shows  the  corresponding  value  of  fixed 
points  or  periodic  orbits,  which  is  different  queue  build¬ 
ups  in  this  context.  We  have  normalized  the  actual  queue 
buildup  by  dividing  it  with  qmin  for  the  easy  of  visual¬ 
ization.  Thats  why  the  legend  on  the  vertical  axis  reads 
Norm,  queueing  at  the  router.  The  way  to  read  a  bifur¬ 
cation  diagram  is  fix  a  point  on  the  horizontal  axis  and 
draw  a  vertical  line.  The  number  of  places  the  bifurcation 
curve  intersect  that  vertical  line  is  the  number  of  equilib¬ 
rium  points  of  the  system.  If  there  is  only  one  point  then  it 
is  a  stable  fixed  point  for  that  parameter  whereas  the  pres¬ 
ence  of  more  than  one  point  indicates  that  system  has  a 
stable  periodic  orbit.  Since  we  have  only  plotted  stable  so¬ 
lutions  corresponding  to  the  different  value  of  parameters, 
the  intersection  of  vertical  line  and  the  bifurcation  curve 
only  indicated  the  number  of  stable  solutions.  Disappear¬ 
ance  of  a  branch  implies  that,  solution  corresponding  to 
that  branch  became  unstable  and  vice  versa.  All  the  bi¬ 
furcation  diagrams  use  three  types  of  symbols.  Red  star, 
green  triangle  and  blue  dot  denote  the  normalized  borders 
b2,  b\  and  the  system  solution  respectively. 

B.  Effect  of  Exponential  Averaging  Weight  w 


where  b2  is  given  by  eq.  10.  Please  note  that  stability  con¬ 
dition  given  by  eq.  14  involves  the  buffer  size  B  despite 
of  the  fact  that  fixed  point  of  the  map  does  not  depend  on 
the  the  buffer  size.  The  inclusion  of  buffer  size  makes  the 
result  conservative  but  it  can  be  argued  that  a  conservative 
design  is  good  for  the  system's  convergence  since  it  has 
finite  capacity  and  hence,  even  a  marginally  stable  system 
may  not  be  acceptable  in  practise. 

V.  Numerical  Results 

The  behavior  of  this  map  can  be  explored  numerically 
in  parameter  space  to  look  for  interesting  dynamical  phe¬ 
nomena.  As  eigenvalue  moves  towards  unit  circle,  fixed 
point  will  become  unstable  and  depending  on  the  nature  of 
bifurcation  there  can  be  new  fixed  points  or  chaos.  There  is 
also  a  possibility  of  fixed  point  colliding  with  either  border 
b\  or  b2  which  has  its  own  rich  world  of  bifurcations. 

A  whole  range  of  different  dynamical  scenario  is  pre¬ 
sented  here.  Lets  first  consider  the  effect  of  varying  qmin 


The  following  parameters  are  common  to  next  three  bi¬ 
furcation  plots  [5]. 

qmax  — 100,  qmin  —  '30,  c — 1500/r6ps,  k —  \J 8/3 
£>  =  300  packets,  Rq  =  0. l.sec,  M  =  0.5kb 
n  =  20,  w  =  bifurcation  parameter 

The  first  three  bifurcation  plots(Figs.  5,6,7)  show  the 
effect  of  varying  the  exponential  weight  w  with  differ¬ 
ent  values  of  pmax ■  For  the  small  value  of  w  these  plots 
have  a  fixed  point  which  looks  like  a  straight  line  but  after 
some  critical  value  of  w  this  straight  line  splits  into  two 
and  this  map  exhibits  period-doubling  bifurcation.  This 
is  first  indication  of  an  oscillatory  behavior  appealing  in 
the  system  due  to  its  inherent  nonlinearity  as  opposed  to 
discontinuity  in  “queue  or  control  law”  which  has  been 
proposed  earlier.  This  period  two  oscillation  starts  batch¬ 
ing  load  at  the  router  as  shown  in  the  plots.  Increasing 


ISR  TECHNICAL  REPORT,  2002 


6 


w  further  shows  that  one  of  the  branches  collide,  with  the 
upper  border  of  the  map  showing  a  chaos  type  phenom¬ 
ena.  This  is  basically  a  bifurcation  sequence  expressed  as 
1  — >  2  — >  chaos.  We  suspect  this  to  be  a  case  of  border 
collision  bifurcation  [12].  Border  collision  bifurcation  is  a 
well  understood  phenomenon  in  piecewise  linear  systems 
and  has  been  shown  responsible  for  chaos  in  different  elec¬ 
trical  circuits  and  economic  system  models.  A  technical 
proof  for  the  border  collision  bifurcation  will  be  reported 
somewhere  else. 

0-  Pmax  —  0.1, 


- 1.12,  a* 


. iii!l:!ii!!![| 


!i!hii:;i;:j 
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1.02 
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10-131  10"1-29  10'1 

Weight  for  exp.  avg.(w)-> 


Fig.  5.  Bifurcation  diagram  of  average  queue  length  w.r.t.  w, 
Pmax  =  0.1 
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* . . 
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Fig.  7.  Bifurcation  diagram  of  average  queue  length  w.r.t.  w, 

Pmax  —  1 


We  also  plot  the  Lyapunov  exponents  for  the  bifurca¬ 
tion  scenario  in  tig.  5  where  pmax  =  0.1.  Fig.  8  shows  that 
in  the  beginning  expoent  is  negative  which  corresponds  to 
the  fixed  point.  It  slowly  increases  to  zero  near  period  dou¬ 
bling  bifurcation  and  then  goes  negative  again.  Finally,  it 
jumps  to  a  positive  value  when  the  border  collides  with  the 
periodic  solution.  Positive  Lyapunov  exponent  conmfirms 
the  existence  of  chaos. 


0.3 


A 

I 

On 

x  „ 

W  0 

Oh 

J 


Border  Coillision- 


Period  ^ 
Doubling 


,'g 

.it#, 


-0.3 


0.04 


w_> 


0.056 


Fig.  8.  Lyapunov  exponent  computed  for  average  queue  length 
w.r.t.  w ,  pmax  =  0.1 


Fig.  6.  Bifurcation  diagram  of  average  queue  length  w.r.t.ui, 

Pmax  —  d**! 


Lyapunov  exponents  for  other  two  scenarios  also  exhibit 
similar  behavior. 
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C.  Effect  of  RED  Control  Parameter  qmin 

The  following  parameters  are  common  to  the  next  four 
bifurcation  plots  [5]. 

Pmax  =  0-3,  qmax  =  W0,  c=  1500kbps,  k=\J 8/3 
£>  =  300  packets,  Ro  =  0.1sec,  M  =  0.5kb, 
n  =  20,  qmin  =  bifurcation  parameter 

0.  w  =  2~5 


Fig.  9.  Bifurcation  diagram  of  average  queue  length  w.r.t. 

w  =  2  5 

1.  w  =  2~6 


Fig.  10.  Bifurcation  diagram  of  average  queue  length  w.r.t. 

Qmini  W  =  2 


Similar  phenomena  are  exhibited  in  these  four  scenar¬ 
ios.  Here  also  there  is  bifurcation  sequence  like  1  — *  2  — > 
chaos  in  figs.  9,  10  and  11  but  scenario  of  fig.  12  shows 
1  — »  2  — >  4  — >  chaos.  It  should  be  noted  that  2  — >  4  is 
not  a  smooth  bifurcation  like  period  doubling  rather,  it  is  a 
border  collision  bifurcation. 

2.  w  =  2~7 


Fig.  11.  Bifurcation  diagram  of  average  queue  length  w.r.t. 

Qmim'W  =  2 

3.  w  =  2-8 


Fig.  12.  Bifurcation  diagram  of  average  queue  length  w.r.t. 

Qmim'W  =  2 

Finally,  we  plot  the  Lyapunov  exponent  corresponding 
to  the  the  bifurcation  scenario  in  fig.  10.  Lyapunov  expo- 
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nent  shown  in  fig.  13  also  stays  negative  in  the  beginning 
like  the  other  one  plotted  in  fig.  8.  In  a  similar  fashion  it 
increases  to  zero  when  the  system  goes  through  a  period 
doubling  bifurcation  and  again  decreases  when  the  system 
has  a  stable  period  two  trajectory.  Finally,  it  jumps  to  a 
positive  value  after  border  collision  bifurcation  and  stays 
there. 


Fig.  13.  Lyapunov  exponent  computed  for  average  queue  length 

w.r.t.  qmin,  w  =  2~6 

VI.  Discussion 

We  have  demonstrated  in  this  paper  that  instability  in 
TCP-RED  can  be  induced  by  the  inherent  nonlinear  be¬ 
havior  of  the  network,  rather  than  by  discontinuity  in 
the  “queue  or  the  control  law”  as  has  been  believed  so 
far  citeaqml.  The  subharmonic  load  batching  very  clearly 
indicates  that  the  system  can  oscillate  if  the  parameters  are 
not  properly  tuned.  We  have  also  given  a  conservative  cri¬ 
terion  for  stable  parameter  settings  based  on  linearized  sta¬ 
bility  analysis. 

Although  the  simulations  have  indicated  a  period-two 
oscillation  with  amplitude  within  five  percent  of  the  nom¬ 
inal  amplitude,  the  appearance  of  period  doubling  behav¬ 
ior  is  of  significance.  The  importance  of  period  doubling 
bifurcation  is  not  in  predicting  the  amplitude  of  the  os¬ 
cillation,  but  rather  in  explaining  the  routes  to  larger  and 
more  pronounced  oscillations  including  chaos.  Also,  the 
results  become  still  more  significant  when  we  think  of  the 
network  as  a  cascade  involving  multiple  routers.  If  one 
router  starts  oscillating,  it  may  transfer  this  instability  on 
the  routers  up  or  downstream  depending  on  the  major  traf¬ 
fic  direction.  Also  depending  on  traffic  conditions  this  in¬ 
stability  may  propagate  throughout  the  network  with  dif¬ 
ferent  time  scales  and  a  systemic  oscillation  can  develop. 
This  needs  further  study.  In  addition,  although  only  anal¬ 


ysis  has  been  studied  here,  it  would  be  interesting  to  con¬ 
sider  implications  of  the  approach  for  control  and  for  pro¬ 
tocol  design. 
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